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Abstract: Students’ ability to practice several thinking skills is one of the problems common in today’s learning. 
Therefore, this research aims to describe the improvement of students’ critical-creative thinking skills through a multivariate 
analysis of the experiment model and gender. The experiment models used in this research are the Multiple Skill Laboratory 
Activity Model (MSLAM) and Higher Order Thinking Laboratory (HOT Lab), with gender, considered as a factor influencing a 
successful learning process. Research method was a quasi-experiment with data obtained from 328 respondents from five 
different universities in Indonesia and analyzed using the multivariate tests. The results showed that the experiment model 
affected the learning outcomes more than genders. Furthermore, the Multiple Skill Laboratory Activity Module proved to improve 
students’ critical and creative thinking skills better than the Higher Order Thinking Laboratory. This study expected to provide a 
comparison in determining the types of suitable experiments for learning at colleges and schools. 
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Introduction 


The critical thinking skills (CrTS) and creative thinking skills (CvTS) are important abilities associated 
with education in this 21* century. Several studies carried out in accordance with these skills showed that 
they were essential to students achievement (Bean, 2011; Pantiwati, 2013; Quieng et al., 2015; Seymour 
et al., 2003). CrIS and CvTS are also used in civil society, with students adopting to the new norms of 
global information. 

Furthermore, studies have also been carried out on the learning process that practiced the use of 
CrTS and CvTS. According to these studies, these skills are practiced using a specific related model of 
teaching (Bustami and Corebima, 2017; Fuad et al., 2017; Hadi et al., 2018; Malik et al., 2020; Malik et al., 
2019; Martaida et al., 2017; Muhlisin et al., 2016; Nasir, 2018; Nugraha et al., 2016; Saputri et al., 2019; 
sari et al., 2018; Seranica et al., 2018; Suardana et al., 2018; Wang et al., 2015; Zaini et al., 2018). In 
these studies, students’ ability increased significantly with the design of specific activities and purposive 
tasks for effective learning. The studies carried out by (Hastuti et al., 2018; Nugraha et al., 2016; Saputri 
et al., 2019; Weatherspoon et al., 2015) showed an increase in CrIS and CvIS by using the learning 
media. This result also showed that student whose used learning media have higher CrIS and CvTS 
compared to those that did not use it, because it made them more active while following the process. 
Besides, learning media was more interesting, which increased their interest and focus. However, another 
research showed that student achievement of CrIS and CvTS can be optimized using the laboratory 
activity or an experiment learning (Lisdiani et al., 2019; Malik et al., 2018; Setiawan et al., 2018). 

However, few studies combined the CrIS and CvIS due to their differing basic approaches 
(Pantiwati, 2013; Seymour et al., 2003). According to Cottrell (2017), Cr!S needed students to think 
deductive, realistic, systematic, and rational which have several aspects such as disposition, criteria, 
argument, reasoning, point of view, and procedures for applying criteria (Cottrell, 2017). These aspects 
were different from the CvTS approach, which comprises originality, elaboration, fluency, and flexibility 
(Lince, 2016). Lince (2016) CvTS approaches comprises of divergence, autistic, emotional, and natural 
and divergence thinking patterns. However, students’ ability to participate in experiment activity is used to 
solve mixed approaches (Lince, 2016). 

The Higher Order Thinking Laboratory (HOT Lab) has implemented the experiment model in the 
colleges and schools. HOT Lab model showed good results in students’ achievement after using it as a 
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learning activity. The research indicated that the practice of competences building is good when used 
in more than once (Setiawan et al., 2018). However, it had several limitations associated with the steps 
and evaluations, therefore the HOT Lab model needs improvement, which can be carried out using the 
Multiple Skill Laboratory Activity Module (MSLAM). 

MSLAM is a module developed to modify the various HOT Lab steps by adding two steps to increase 
CrTS and CvTS. The CrlS and CvTS were practiced using MSLAM with the effect analysed by carrying 
out a Multivariate test in accordance with Models and Gender. Analysis by gender is used to provide 
information on gender contribution in laboratory activity. This study aims to describe the improvement of 
students’ critical-creative thinking skills after using MSLAM as a HOT Lab refinement module. Therefore, 
teachers in college or schools need to carry out learning more optimally. 


Research Question 

1. How do the experimental models of students’ critical-creative thinking skills simultaneously 
contribute to their knowledge? 

2. Does gender affect student's critical-creative thinking skills, which are simultaneously practiced? 


Materials and Methods 


This is a quantitative and experimental research with data consisting of students’ critical and 
creative thinking skills in two groups. The physics contents taught in this study are electric current (El-Cr) 
and elasticity (Elc). The respondents in this study were 328 students divided into 10 subject groups. The 
first five groups also are known as the control groups, carried out the HOT Lab model, while the remaining 
five, which utilized the MSLAM model were in the experimental class. Groups A, B, C, D, and E comprises 
of students from the UIN Sunan Gunung Djati Bandung (Java), UIN Imam Bonjol Padang (Sumatra), UIN 
Alauddin Makasar (Sulawesi), IAIN Palangka Raya (Kalimantan), and IAIN Syech Nurjati Cirebon (Java), 
respectively. Each selected group subject has heterogeneous academic abilities with different habits and 
learning experience. 

Data were collected using an essay test-form, which includes CvIS and CrTS. The CvTS test 
consists of four indicators modified through creative thinking from Almaeida (Almeida et al., 2008) and 
Alrubaie (Alrubaie and Daniel, 2014). Research techniques that are flexible, elaborating, and innovating. 
The CrTS test consists of seven indicators modified trom Binkley (Binkley et al., 2012) and Tiruneh’s 
(Tiruneh et al., 2017) research techniques: reasoning, interpreting, explaining, synthesizing, evaluating, 
and inferencing. Furthermore, all of the results were analysed using the normalized gain result of each 
subject's groups <g> (Hake, 1999). 

N-gain scores are then used as the data source for multivariate tests, which consist of three parts 
that analyzed the experiments, gender, and combination between the experiments and gender. The 
experiment was used to analyze the influence of added syntax to the critical and creative thinking skills of 
students. While gender analysis aimed at seeing the contribution of gender in experiment-based learning. 


Results 


The results of this study consist of the Manova analysis, which influences each independent variable 
(experiment model, gender, and combination of both) and the dependent (CrTS and CvTS) in all subjects. 


Analysis of the experiment learning model 

The first analysis is used to determine how the experiment model influences students’ CrTS and 
CvTS, which are simultaneously trained through different experimental activities, such as HOT-Lab for 
the control class and MSLAM for the experiment. Table 1, 2 and 3 show the results of Manova analysis 
presented in the form of a multivariate test, Levene’s Test of Equality of Error Variances, and Test of 
Between-Subject Effects. 
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Table 1 
Multivariate test by Pillai's Trace method 


subjects GroupA GroupB GroupC GroupD GroupE 
Value 0.305 0.395 0.275 C552 0.521 
F 15.81 8.973 5 A487 746 19.047 
sig. 0.000 0.000 0.001 0.000 0.000 


Based on Table 1, it can be concluded that the experimental models have a significant influence 
on CrIS and CvIS. This result is expressed by a p-value smaller than 0.05 in each test, which 
gives the overall conclusion that experimental model has a significant effect on CrIS and CvIS. 


Table 2 
Levene’s Test of Equality of Error Variances 


Contents El-Cr Elc 
Group A B C D E <A B C D E 
CvIS) 0026 0113 0.175 0175 0105 - 0048 0135 0048 0.000 
CriS 0.000 0297 0.003 0003 0026 - 0003 0008 0195 0195 


Table 2 showed that students in the control and experiment classes are in an inhomogeneous 
group. Most of the scores are higher than 0.05, in accordance with the score and significance values, 
therefore the data are homogeneous. This result showed that the student’s score of CrIS and CvIS are 
in the control class using HOTs Lab model, while the experiment class produced different results using 
the MSLAM (Stichter et al., 2019). Meanwhile, the data classified in each competence, can improve CvTS 
using the MSLAM, because the average significance score is 0.091. This result showed that the group's 
variant is relatively different, with an average CrIS significance score of 0.081 (Mertler and Reinhart, 
2016). Table 3 shows the Test of Between-Subject Effects analysis, which was carried out to provide a 
detailed answer. 


Table 3 

Test of Between-Subject Effects 
(sroup A B C D E 

SS —— 
Contents ElCr Ele ElCr Elec ElCr Elec ElCr Ele ElCr Ele 
Intercept 0.000 - 0.000 9.000 0.000 0.000 0.000 0.000 0000 g 000 

CvTS Experiment 0.000 - 0622 Q0000 0331 0000 0013 0.000 0009 0.004 
Error 0O05/ - O115 O0/74 0104 0.051 0.062 0.064 006 O07 
Intercept 0.000 - 9.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 

CrfS Experiment 0.009 - 0.033 0.042 0.025 0.013 0.033 0.042 0.012 0.000 
Error 0060 - OQ057 0062 0078 0055 O057 0.082 0083 0.079 


This test was used to determine the contribution of each experiment model that improved students’ 
CrTS and CvTS. Table 3 shows an intercept value on each variable, which is less than 0.05, which means 
that it is significant. Therefore, the experimental model, HOT Lab, and MSLAM contributed differently with 
a significant value of student achievement in each group (Cronk, 2017; Mertler and Vannatta, 2002). 

In addition, there is a significant value that specifically illustrated the effect of the experiment model 
on the dependent variable. Furthermore, the significant value of the model, which is less than 0.05, 
positively improved the CvTS in the Elc content. This result is different from the increase in CvTS on El-Cr 
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content with a significance value greater than 0.05 in two groups. 


Gender analysis 

This was carried out to acquire an overview of gender effect in increasing students’ CvTS and 
CrTS. A total of 328 students comprising 61 males and 267 females were used to carry out this research. 
The first analysis is multivariate test significance, as shown in Table 4. 


Table 4 
Multivariate test by Pillai's Trace method 


subjects GroupA GroupB GroupC GroupD GroupE 
Value 0.065 0.038 0.048 0.019 0.127 
fe 2.522 0.547 0.735 0.265 2.537 
sig. 0.087 0.702 0.572 0.899 0.048 


Table 4 shows that the overall independent variable, or gender, did not affect the values of CvIS 
and CrTS ata significance value above 0.05 in each group. Therefore, this indicates that gender does not 
influence the significant increase of CvIS and CrTS. Meanwhile, the differences in student scores can be 
analysed by their gender, as shown in Table 5. 


Table 5 
Levene’s Test of Equality of Error Variances 


Contents El-Cr Ele 


Group A B CG D i At B C D E 
CvIS O009/ 0641 0641 0591 0186 - O05 O05 0698 0.153 
Cris 0309 O15/ O157 0328 0904 - 0362 0362 O75 0.361 


Table 5 shows that the most significant value is higher than 0.05, which means that the scores of 
CvTS and CrTS are definitely different (Stichter et al., 2019) due to students’ efficacy and anxiety in the 
learning process (Assan and Sarfo, 2015). This is similar to the studies carried out by (Chang, S., and 
Cho, 2013; Hill et al., 2016), which stated that female students are more anxious than males, especially 
in math. 


Table 6 

Test of Between-Subject Effects 
Group A B C D E 

SS | TT 
Contents El-Cr Elec ElCr Ele ElCr Ele ElCr Elec  ElCr’ Elec 
Intercept O§.000 - Q.000 0000 0000 0.000 0.000 0.000 0.000 0.000 

CvIS Gender O/799 - 0565 0222 0564 O187 O729 0966 0.026 0.052 
Error = 0.073) - Ss 0.115 )=— 0.061 0.105 «80.066 0.091 0061 0.061 0.075 
Intercept 0.000 - Q000 0000 0000 0.000 0.000 0.000 0.000 0.000 

CriS) Gender 0.029 - 0923 0616 O779 0.748 0534 0501 0.552 0.783 
Error =60.060) S-)S 0.110 0.067 0.059 0085 0.083 0087 0.090 0.132 
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Table 6 shows that the intercept value on each variable is less than a significance of 0.05. (Bergold 
et al., 2017) stated that gender contribution Is insignificant because the average score is 0.457 for CvIS 
and 0.607 for CrIS. According to (Cronk, 2017; Mertler and Vannatta, 2002), gender contribution Is 
significant when the score is less than 0.05. This result is particularly accurate at average errors of 8.81% 
and 7.87% for CrTS and CvTS, respectively. This is in accordance with the socio-scientific research and 
principles of correctness which amounted to 91.19% and 92.13% for critical and creative thinking skills. 


Combined analysis of experiment types and gender 
The last analysis reviews the simultaneous contributions of the experimental and gender models 
to improve CrTS and CvITS. 


Table 7 

Multivariate test by Pillai's Trace method 
Group A B C D E: 
d-factor= exp gen Exp gen exp gen exp gen exp gen 


Value 0316 0081 O397 0042 049 0275 O351 0018 O522 0.128 
F 16.430 3.110 8898 0592 0/738 5412 (7.312 0253 18628 2.530 
sig. 32.86/ 0.051 0000 0670 05/70 0.001 0000 0907 0000 0.048 


‘d-factor is different factors that used In analyse, exp = expenment type, gen = gender 


Table 7 shows a variety of spreads with significant values in the experiment and gender models of 
group A higher than 0.05. In group B, the experiment and gender models are significant and insignificant 
at values of 0.00 and 0.67. Furthermore, in group C, the experiment and gender models are insignificant 
and significant at values of 0.57 and 0.001. In group D, the experiment model provides a significant 
influence, as opposed to gender. The last group shows a significant influence on both aspects. Therefore, 
it can be concluded that the analyzed student competencies are separately carried out due to the varying 
basic point of view (Berglund and Gericke, 2016; Garcia and Mayorga, 2018; Kottorp et al., 2019). 


Table 8 
Levene’s Test of Equality of Error Variances 


Content El-Cr Elc 


Group A B C D FE UA B C D E 
CvIS 0000 0311 O388/f 0200 0042 - Q050 00/76 0493 0189 
Cris 0025 0039 0069 0465 0259 - 0123 QO0/70 0186 0.000 


The analysis of homogeneity indicates that there are differences in CrlS and CvIS of the 
experimental and control classes. In CvIS, Levene’s Test’s average score is significant because it is 
0.194 greater than 0.05. This means, that the experimental and gender models are different in accordance 
with students’ scores. The same result is also shown by CrTS average score with 0.138 above 0.05 and 
different from their experiment and gender models (Stichter et al., 2019). 


www.ijcrsee.com 
53 


Malik, A. & Ubaidillah, M. (2020). Students critical-creative thinking skill: A multivariate analysis of experiments and gender, 
International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), (8), Special issue of Current 


Research and Trends in Cognitive Sciences 2020, 49-58. 


Table 9 
Test of Between-Subject Effects 
(Sroup A B C D Fz 
aoa —E>>>>>=>——————ESESSE=EE=E EE 
Contents El-Cr Ele ElCr Ele ElCr Elec ElCr Ele ElCr- Ele 
Intercept 0.000 - 9.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 
CvIS Experiment 0.968 - O5/75 0169 0644 0262 0/762 0545 0.013 0.061 
Error 0000 - Q633 0000 0366 0.019 0.014 0 0.005 0.005 
Intercept 0.000 - 9.000 0.000 0000 0.000 0.000 0000 0.000 0.000 
CGriS) Experment 0.015 - 0882 0575 O411 O54 0976 0459 0634 0.976 
Error 0005 - 0035 0042 0000 0.022 0035 0.042 0.013 0.000 


Table 9 shows an explicit analysis of the contributions of two independent variables against two 
dependent variables simultaneously. It provides the same intercept value in each group indicating that the 
experiment and gender models are capable of significantly changing each subject group's value for the 
improvement of CrTS, and CvTS. 

Furthermore, the overall data on Table 9 shows that gender does not significantly improve CrTS and 
CvTS, as opposed to the experiment model. Lastly, the data error, of the combination analysis provides 
a relatively small error with an average error of 7.01% and 7.53% for CrIS and CvTS. This shows that 
the method used in this research has an acceptance rate of 92.99% and 92.47% for increasing CrTS and 
CvTS. 


Discussion 


The research results showed that experimental model has significant affect to improve student's 
CrIS dan CvIS simultaneously. This is unique because these two competencies have different 
characteristics from one another. CrTS are convergent thinking skills, meaning that if they are trained 
students must be able to carry out various analyzes of facts and draw conclusions from the multiple facts 
found. In contrast to CvTS which have divergent characteristics where students are trained to have high 
curiosity, elaboration, flexibility and tend to rely on imagination. Even though these two abilities do not 
collide with each other in a cognitive context, in carrying out practicum activities using the MSLAM model, 
these two abilities can be trained simultaneously. Refer to the model syntax and practicum steps in the 
MSLAM model, which can develop CrTS and CvTS. 

The development of creative and critical thinking skills through elasticity and electricity practicum 
activities using MSLAM can be viewed from several stages. The stages of practicum activities that can 
train and develop aspects of critical thinking skills include real-world problems, experimental questions, 
brainstorming, conceptual questions, prediction, analysis, evaluation, and reflection. Creative thinking 
skills that can be developed through various stages of MSLAM practicum include brainstorming, proposing 
alternative ideas, exploration, and measurement. Critical and creative thinking skills can be developed 
through brainstorming (Chang et al., 2015). The activity of proposing alternative ideas as part of divergent 
thinking can give birth to new methodologies, generate new ideas, and students’ scientific practice. 
(Abraham, 2013; Antink-Meyer and Lederman, 2015). 

The explanation of these findings is due to the habits of students while carrying out experiments. 
Based on a study conducted by Lin et al. (2004), another aspect related to the scientific process Is the 
logic of science as a form of logical thinking. Therefore, laboratory activities also provide a rich context for 
using shared logical thinking between CvTS and CrTS (Koray and Koksal, 2009). Thus, from the point of 
view of activity steps, it can be stated that MSLAM can train CrTS and CvIS. 

The other side, Elc is part of the mechanical content where students carried out mechanical 
experiments more often than electronica experiments since middle school. It is different from the 
implementation of El-Cr experiment, which is often ignored, and made them possess less level of their 
CvTS. This finding is consistent with the studies carried out by (Harris and de Bruin, 2018; Irjayanti and 
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Azis, 2017; Lucas, 2016). In the review of the CrTS, it is apparent that all the subject groups in each 
content have a significance value of less than 0.05, with MSLAM providing more effect to CrTS than HOTs 
Lab. When the results were reviewed, this study obtained the average error rate for CvTS 7.52% and 
CrTS 7.03% which is relatively small for the research group socio-scientific (Nuijten et al., 2016; Rahman 
et al., 2017; Vazquez-Cano et al., 2017). Therefore, it can be concluded that the addition of HOT Lab 
model's several steps has succeeded in increasing students CvTS and CrTS simultaneously. 

In other side, gender analysis showed an insignificant influence on improving CvTS and CrTS. 
According to previous studies, students’ syntax, level of difficulty, habit, and motivation are also some of 
the reasons for the insignificant values. In the performance process, male students tend to perform better 
than their female counterparts. However, in the data processing, analysing and reporting stages, the 
reverse was the case. This finding is also reinforced by the results of previous studies which show that 
generallly there is no difference in ability between male and female students, but only in a few conditions 
(Adolphus and Omeodu, 2016; Aeschlimann et al., 2016; Becirovic, 2017; Brodahl et al., 2011; Crymble, 
2016; Master et al., 2017; Putri et al., 2018; Sayed and Mohamed, 2013). This result is different from 
previous research in that male students tend to have better analytical thinking skills than female students. 
Lin et al. (2004) stated that CvTS and CrTS as higher-order thinking skills are related to other variables 
such as age, cognitive level and field of study. The results also contradict the statement that female 
students have higher levels of CvTs than male students at the university level (Matud, Rodriguez, and 
Grande, 2007): female students performed better on divergent thinking tests, while male abilities were 
superior in insightful problem-solving tasks (Lin et al., 2012); In divergent thinking, men have a stronger 
declarative memory, while women have advantages in the theory of mind, social perception, speech 
processing and reference processing (Abraham et al., 2014); male students have higher creativity than 
female students when they produce the same output (Proudfoot, Kay, and Koval, 2015). 

These findings have a relatively high level of accuracy based on the error value that provide a 
relatively small error value of 7.52% and 7.03% for the experimental models of CvTS, and CrTS. Meanwhile, 
using the gender model, it produced 7.87% and 8.81% for CvTS, and CrTS, with 7.53% and 7.01 for the 
simultaneous models of experiment and gender to CvTS, and CrTS (Nuijten et al., 2016; Rahman et al., 
2017; Vazquez-Cano et al., 2017). Therefore, in conclusion, MSLAM has the ability to adapt two thinking 
skills at once. Therefore, efforts are needed to take a wider implementation to determine the effectiveness 
of this model. 

The limitation found in this study is in combination analysis methods, which were carried out by 
combining the experiment and gender models, which are the external and internal factors of students. These 
results are biased because gender influences students’ learning interests, especially their experimental 
activities. Therefore, subsequent studies need to be carried out for students’ tendency factors based on 
gender, to obtain more accurate measurement results. 


Conclusions 


The results showed that experimental learning using MSLAM can improve CrIS and CvIS 
simultaneously. MANOVA test suggests that the MSLAM contributes more significantly to the HOT 
Lab. Besides, gender analysis showed an insignificant influence on improving CvTS and CrIS. These 
contributions provide a relatively small error value of 7.52% and 7.03% for the experimental models 
of CvTS, and CrTS. Meanwhile, using the gender model, it produced 7.87% and 8.81% for CvTS, and 
CrTS, with 7.53% and 7.01 for the simultaneous models of experiment and gender to CvTS, and CrTS. 
Therefore, in conclusion, MSLAM can adapt two thinking skills at once. Therefore, efforts are needed to 
take a broader implementation to determine the effectiveness of this model. 
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